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Abstract. Language teachers, as one might expect, are often confronted with the task 
of assessing and grading students’ assignments, which should ideally be addressed with 
respect to not only reliability and validity, but also functionality. Based on Knoch’s (2011) 
taxonomy features with regards to design and development of writing assessments, an 
analytic approach was devised to assign scores to a certain amount of independent aspects 
of language learners’ performance through the means of specific rubrics. The rubrics, 
elaborated with the graders and students in mind, describe the rating of the various 
tasks intermediate learners of French had to undertake. Following a brief description 
of one assignment, this short paper highlights the significance of following the scoring 
grids to maintain a relatively constant grading style across students and teachers alike. 
Additionally, it illustrates how Google documents and forms, used in conjunction with 
simple and undemanding scripts, assisted in the process of correcting and providing 
students with timely feedback. 
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1. Introduction 

Responding to Yancey’s (1999) call for a “fourth wave” of writing assessment (p. 500), 
i.e., a call for assessment that moves beyond multiple-choice questions, scored essay 
tests, and portfolio assessments, Wardle and Roozen (2012) propose an ecological 
model of writing assessment that considers both the vertical and horizontal dimensions 
of students’ development. In short, they emphasise the idea that “the breadth of students’ 
[...] literate experiences - in and out of school - impacts their ability to ‘do’ academic 
literacy tasks” (Wardle & Roozen, 2012, p. 107, emphasis in original). While the 
authors’ reflection seems appropriate and full of common sense, adapting their model 
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of writing assessment would be a rather complicated endeavour as it implies including 
data from different modules and other non-canonical texts from outside the academic 
structures. 

Assessing learners’ writing is a challenging task for teachers, as it involves serious 
considerations on how to evaluate the learners’ ability to write. As Behizadeh and 
Engelhard (2011) reported, “[i]t was much easier to objectively score multiple-choice 
tests, as compared to complex writing samples” (p. 202). Whichever approach is 
used, one aim of assessing and evaluating written language is to diagnose learners’ 
weaknesses and strengths, in other words, to “identify those areas in which a student 
needs further help” (Alderson, Clapham, & Wall, 1995, p. 12). Knoch (2011) further 
points out that “integral to diagnostic writing assessment is the rating scale” (p. 81). 

Weigle (2002) discusses factors that should be considered when designing rating 
scales and scoring rubrics, such as who is going to use them and how the scores will be 
reported (pp. 122-124). Rubrics are generally defined as “systematic scoring guidelines 
to evaluate students’ performance [...] through the use of a detailed description 
of performance standards” (Zimmaro, 2007, p. 1). Knoch (2011) observes that “no 
currently available theory can serve by itself as a basis for the design of a rating scale 
for writing for diagnostic assessment” (p. 90). To remedy, she proposes a taxonomy 
of features - accuracy, fluency, complexity, mechanics, cohesion, coherence, reader/ 
writer interaction, and content - that could be used as a basis for the design of a rating 
scale (Knoch, 2011, p. 91). 

Based on Zimmaro’s (2007) practical steps in designing rubrics to grade a student’s 
performance, and Knoch’s (2011) taxonomy features, this short paper illustrates 
how rubrics combined with Google scripts help provide language learners with fast 
corrective feedback and grades. 

2. Educational setting and assignment 

Students were enrolled at university level in various Bachelor degrees in which the 
French language was either an obligatory or a facultative component of their formation. 
As part of their assignment, they had to experience French autonomously and were 
asked to write an account of their activities as well as to reflect on their learning 
outcomes. A minimum of 800 words with at least eight different entries was imposed 
on students. 

3. Elaboration of the scoring rubrics 

Fearners’ written documents were assessed according to five criteria carrying equal 
weight: (1) content, (2) vocabulary, (3) conjugation, (4) syntax, and (5) reflection. The 
first category identified whether the texts provided were adapted to the task and whether 
the instructions were respected. The second criterion of assessment acknowledged 
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the lexical diversity, whether the vocabulary was sufficient for explaining the chosen 
activities. The third criterion identified whether the verbs were correctly conjugated 
with an appropriate tense. The fourth criterion evaluated the syntax of the sentences, 
whether the structures were simple or complex. Finally, the last criterion examined the 
breadth of the learners’ reflection and whether it was thoughtfully considered. 

All criteria were rated on a 5-point rating scale in accordance with the university’s 
regulations*, i.e., Fail (<40%), H3 (40-49%), H2.2 (50-59%), H2.1 (60-69%), and HI 
(>=70%), as illustrated below with the “reflection” criterion (Table 1). Note that the 
original rubrics were in French, but were translated into English for the purpose of this 
publication. 

Table 1. Scoring rubrics 



Fail (<40%) 

H3 (40-49%) 

H2.2 (50-59%) 

H2.1 (60-69%) 

HI (>=70%) 

Reflection 

No reflection on the 
language learning 
is present. 

Newfound skills 
cannot be 
identified. 

Reflection on 
language learning 
is inept. Newfound 
skills can be 
identified. 

Reflection on 
language learning 
is still inept, but 
newfound skills are 
clearly identifiable. 

Good reflection on 
language learning 
and newfound 
skills are clearly 
identifiable. 

Excellent reflection 
on language 
learning and 
newfound skills are 
clearly identifiable. 


4. Template, form and script to report grades 

Google documents, forms, and scripts were used to assess the learners’ written account 
of their learning experience, as well as to provide them with their respective scores. The 
template, as illustrated below in Figure 1 , was created with the same word-processing tool. 
The shaped document served as a starting point for each student, and variables - preceded 
with the @ sign - were automatically filled in depending on the teacher’s scoring. 


Figure 1. Template 


2011/2012 

Bar&me de notation et results ts 

Please note that these results are provisional and will only be confirmed after the examination board meeting. 


Date de la correction : @date 


Norn du correcteur: ©corrector 
Nom de I'etudiant: ©student 


Note sur 100 : ©percent 
Note sur 30 : ©relative 


Crtteres 

Entree 1 

Entree 2 

Entree 3 

Entree 4 

Entree 5 

Entree 6 

Entree 7 

Entree 8 

Entree 9 

Entree 10 

Contenu etclarte 

@q11 

@q21 

@q31 

@q41 

@q51 

@q61 

@q71 

@q81 

@q91 

@q101 

Vocabulaire 

@q12 

@q22 

@q32 

@q42 

@q52 

@q62 

@q72 

@q82 

@q92 

@q102 

Grammaire-Verbes 

@q13 

@q23 

@q33 

@q43 

@q53 

@q63 

@q73 

@q83 

@q93 

@q103 

Grammaire - Autres 

@q14 

@q24 

@q34 

@q44 

@q54 

@q64 

@q74 

@q84 

@q94 

@q104 

Reflexion 

@q15 

@q25 

@q35 

@q45 

@q55 

@q65 

@q75 

@q85 

@q95 

@q105 


Commentalre : 


©comments 


* Marks and Standards. (2012). Retrieved from: http://www4.dcu.ie/sites/default/files/registry/pdfs/M-S_version-2012.1.0.pdf 
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The Google form (Figure 2) enabled the assessment of the written texts in accordance 
with the scoring grades. Once the data was entered into the form, and that the form 
was saved, the data was sent to the spreadsheet that was automatically generated by 
the system. 

Figure 2. Form 

FR103 - bilan 

* Required 

Correcteur * 

O Sylvie Thouesny 
O Corrector #2 

Norn de I'etudiant * 


Entree 1 



Fail 

H3 

H2.2 

H2.1 

HI 

Contenu et clart6 

O 

o 

o 

o 

o 

Vocabulaire 


o 

~~o 

-o 

”5 

Grammaire - Verbes 

O 

o 

o 

o 

o 

Grammaire - Autres 

~'o 

o 

”6 

~~o 

~o 

Reflexion 

o 

o 

o 

o 

o 

Entree 2 

Fail 

H3 

H2.2 

H2.1 

HI 

Contenu et clart6 

O 

o 

o 

o 

o 

V/orptv tlsi r»» 

O 

n 

O 

n 

n 


Commentaires * 


Submit 

Powered by Google Docs 

Report Abuse - Terms of Service - Additional Terms 


The aim of the script was then to get the last data entered in the active spreadsheet so 
as to fill the information into the template. Each variable in the template was replaced 
with its corresponding data, as illustrated in Figure 3 below*. 


* A more detailed account on the script can be found on my website: http://blog.icall-research. 
net/2011/10/23/template-and-script-to-report-grades-of-leamers-of-french 
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Figure 3. Script 


37 //insert information into template from spreadsheet 

38 copy_body.replaceText{ "@comments" , comments); 

39 copy_body.replaceText( "^corrector" , corrector); 
copy_body.replaceText( "@student", student); 

41 

42 //retrieve results per question 

43 var sum ■ 0;//to compute average 

44 var count ■ 0;//to compute average 

45 var question_number " 1; 

46 for (var i ■ 0; i <■ index_comment; i++) { 

if (data[0][i] in levels || data[0][i] — "" ){ 
var index - 0; 

for (var j - 1; j <- amount_of_controls; j++) { 

//replace text in template by result e.g. "Qll" ■> "H2.2" or 0 if question not answered 
if (data[0] [i+index] ■■ "" && question_number<-entries_required) { 
copybody .replaceText( "@q"+question_number+j , 0); 
count++; 

> 

else if (data[ 0]( i+index] ■■ "" && question_number>entries_required) { 
copybody .replaceText( "§q"+question_number+j , "-") ; 

> 

else { 

copy_body .replaceText( "@q"+question_number+j , data[0] (i+index] ); 

sum - sum + levels ( data (0]( i+index ]]; 

count++; 

> 

index++; 

> 

question_number++ ; 
i-i+index-1; 

> 

68 } _ 


The result was as follows (Figure 4): 


Figure 4. Result 


2011/2012 

Bar6me de notation et rdsultats 

Please note that these results are provisional and will only be confirmed after the examination board meeting. 

Date de la correction : 21 Dec 201 1 


Nom du correcteur: Sytvie Thouesny 

Note sur 100 : 59 

Norn de l'6tudiant: Jane Doe 

Note sur 30: 17.7 


Crlteres 

Entr6e 1 

Entree 2 

Entr6e 3 

Entr6e 4 

Entree 5 

Entree 6 

Entr6e 7 

Entree 8 

Entr6e 9 

Entree 10 

Contenu etclarte 

H2.1 

HI 

HI 

H2.1 

H2.1 

HI 

HI 

H2.1 



Vocabulaire 

H2.2 

HI 

H2.1 

H2.2 

H2.2 

H2.1 

H2.2 

H2.2 

- 


Grammaire-Verbes 

H2.2 

H2.1 

H2.1 

H2.2 

H3 

H2.1 

H2.2 

H2.2 

- 

- 

Grammaire - Autres 

H2.2 

H2.1 

H2.1 

H2.2 

H2.2 

H2.1 

H2.2 

H2.2 

- 

- 

Reflexion 

H2.2 

H3 

H2.2 

Fail 

H2.2 

H3 

H2 2 

H3 

- 

- 


Commentaire: 


La presentation est agreable et les references sont mentionnees. Quelques fautes d'accord et de genre. Le vocabulaire est g6n6ralement bien choisi. Les 
activites sont interessantes. La reflexion sur I'apprentissage de la langue en autonomie est parfois maladroite et superficielle. Travail satisfaisant. 


Each score sheet was accompanied with the score grids so that students knew exactly 
what the rating on each section implied. This sheet could then have been shared with 
the student through Google Drive (formerly Google Docs) or sent via email. 
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5. Discussion and conclusion 

This short paper illustrated how scoring grids combined with the use of Google 
documents, forms, and scripts would assist in assessing and scoring texts written by 
learners as a response to an open task. Although Kulhavy (1977) reported that “delaying 
the presentation of feedback for a day or more leads to significant increases in what 
students remember on a retention test” (p. 214), more recent research has highlighted 
the significance of timely feedback (e.g., Denton, Madden, Roberts, & Rowe, 2008). 
By following a scoring grid and using a script that automatically fills in a template, 
it is manageable to have a rapid and constant grading across students and tasks, 
which means that variations due to tiredness or subjectivity can be easily avoided. 
It is nevertheless always pertinent to perform a second rating by another rater, which 
will indicate fairness to students (see Penny and Johnson (2011) for a classification of 
resolution procedures in scoring writing assessment). 
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